BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

The present invention relates to a structure for mounting 
a stereo camera apparatus which takes photograph of an object 
from different points of view for calculating a 
three-dimensional distance distribution of the object. 

2 . Description of the Related Art 

Generally, image processing by a so-called stereo method 
is known as an image-based three-dimensional measuring 
technique. In this stereo method, an object is photographed 
from different positions with a stereo camera apparatus which 
is composed of a pair of cameras , or a main camera and a sub- camera . 
Then a distance between the stereo camera apparatus and the 
object is determined from a parallax of the same object using 
camera parameters based on the principle of triangulation . 
Camera parameters are, for example, themount ingposition, focal 
length of the stereo camera apparatus and the like. 

Specifically, in such image processing using the stereo 
method, a small region in a reference image photographed by 
the main camera is superimposed on an area within search area 
set in a comparative image photographed by the sub-camera while 



successively shifting the small region pixel by pixel. Then, 
a position of an area within the search area corresponding to 
the small region of the reference image is obtained, the 
corresponding area having image signal coincident with image 
signal of the small region. Information on the distance to 
the object is then obtained from a positional difference 
(parallax) of the same object on the pair of the images, or 
the reference image and the comparative image, using the 
principle of triangulation . 

y 

The stereo camera apparatus used in the aforementioned 
image processing is installed such that it is oriented to a 
front of a vehicle, or in an axis direction of the vehicle. 
A search area to be set in the comparative image is set in a 
striplike area as shown in Fig , 2A, which extends from a posit ion 
substantially corresponding to a small region in the reference 

image toward the main camera. Therefore, as is apparent from 

f 

Figs. 2B and 2C, for a small region located in a specific zone 
of the outside (right side) of the vehicle in the reference 
image, it is impossible to allocate a corresponding search area 
in the comparative image and obtain distance information thereon 
For this reason, an area in which a three-dimensional distance 
distribution is generated by the aforementioned image 
processing is inclined toward the sub-camera side (left side) 
with respect to the central axis of the vehicle as shown in 



Fig, 2D. Consequently, it might be impossible to obtain a 
three-dimensional distance distribution having a sufficiently 
large area for an object to be photographed. 

On the other hand, to enable detection of an infinite 
5 distance corresponding point where the parallax is zero when 
searching through -the comparative image for a corresponding 
position of a small region in the reference image, it is necessary 
to set a search margin in amatching search area in the comparative 
image as shown m Fig. 4, When the reference image is produced 
10 using up to extreme ends of camera frame, however, it becomes 
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impossible to provide the search margin. 



SUMMARY OF THE INVENTION 



pJ This invention has been made in the consideration of the 

O 15 aforementioned circumstances. An object of the present 

O 

invention is to provide a structure for mounting a stereo camera 
apparatus which makes it possible to set a three-dimensional 
distance distribution symmetrically on left and right sides 
of the central axis of a vehicle and thereby produce a necessary 
20 and sufficient three-dimensional distance distribution. 

Another object of the present invention is to set a search 
margin in such a way that the infinite distance corresponding 
point can be detected even when the reference image is produced 
using up to extreme ends of camera frame. 
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The objects can be achieved by a structure for mounting 
a stereo camera apparatus comprising a main camera and a 
sub-camera. The main camera takes photograph of an object in 
a shooting direction. The sub-camera takes photograph of the 
5 object from a point of view different from a point of view of 
the main camera. The main camera and sub-camera are disposed 
with a predetermined spacing in a direction substantially 
perpendicular to the shooting direction. Optical axes of the 
main camera and the sub-camera are inclined toward the main 
™ 10 camera side with respect to the shooting direction between the 
_g main camera and the sub-camera. Each of the cameras may be 

,p made of CCD camera. The cameras maybe mounted in the vicinity 

□ of a rear-view mirror of a vehicle, so as to take photographs 

fy of views outside the vehicle. 

Q 15 In the structure for mounting the stereo camera apparatus 

□ 

of the invention, it is preferable that the optical axis of 
the sub-camera is inclined toward the sub-camera side with 
respect to the optical axis of the main camera. 

Further, in the structure of the invention, • it is also 
20 preferable that angles of inclination of the main camera and 
the sub-camera are set to be such angles that make an area 
substantially left-right symmetric with respect to a central 
axis of a vehicle parallel to the shooting direction, the area 
being an area of three-dimensional distance distribution 
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obtained on the basis of images photographed by the cameras. 
The optical axis of the sub-camera may inclined toward the 
sub-camera side with respect to the optical axis of the main 
camera . 

5 Furthermore, it is preferable that the structure of the 

invention further- comprises : 

a camera stay for mounting the cameras thereon, wherein 
a longitudinal direction of the camera stay is substantially 
perpendicular to the shooting direction. 
10 The ob j ects can be also achieved by a structure for mounting 

i 

■a-! 

a stereo camera apparatus which has a main camera and a sub-camera 

£ taking photograph of a common object in a shooting direction 

Q from different points of view and being disposed with a 

. « 

lU predetermined spacing in a baseline direction substantially 

y 15 perpendicular to the shooting direction, the stereo camera 
apparatus identifying a correlated destination of a first image 
photographed by the main camera within a second image 
photographed by the sub-camera and then calculating a parallax 
of the first image. Optical axes of the main camera and the 
20 sub-camera are inclined toward the main camera side with respect 
to the shooting direction between the main camera and the 
sub-camera . 

In the structure for mounting the stereo camera apparatus 
of the invention, it is preferable that an acute angle defined 
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between the optical axis of the main camera and the baseline 
direction is smaller than an acute angle defined between the 
optical axis of the sub-camera and the baseline direction. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a schematic construction diagram of a 

stereoscopic image processing system; 

Figs. 2A-D are respectively explanatory diagrams of a 

three-dimensional distance distributions- 
Fig. 3 is a top view of a stereo camera unit; and 
Fig. 4 is a diagram showing a search area in a comparative 

image necessary for detecting an infinite distance 
corresponding point . 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

A mode of carrying out the present invention, or an 
embodiment thereof, is described below with reference to 
drawings . Figs . 1-3 relate to the embodiment of this invention, 
in which Fig. 1 is a schematic construction diagram of a 
stereoscopic image processing system. Figs. 2A-D are 
respectively explanatory diagrams of areas for generating a 
three-dimensional distance distribution, and Fig. 3 is a top 
view of a stereo camera unit. 

In Fig. 1, the reference numeral 1 designates the 
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stereoscopic image processing system which is installed on a 
vehicle like a motor vehicle and recognizes an object ahead 
of the vehicle. This stereoscopic image processing system 1 
comprises a stereo camera unit 2 which takes stereoscopic 
5 photographs and an image processing unit 6 which produces a 
three-dimensional- distance distribution of the object ahead 
of the vehicle by performing a stereoscopic image processing 
on a pair of images photographed by the stereo camera unit 2. 
The aforementioned stereo camera unit 2 is constructed 
10 mainly of a main camera 4, a sub-camera 5 and a camera stay 
^ 3. The main camera 4 and the sub-camera 5 are both made of 

CCD cameras, for example, and assembled to the camera stay 3 
□ with a specific distance between them. The camera stay 3 is 

3 3 J 

ry mounted in the vicinity of a rear-view mirror of the vehicle. 

G 15 The aforementioned main camera 4 is attached to a right end 

o 

of the camera stay 3 and captures a reference image (right image) 
which is needed by the aforementioned image processing unit 
6 when it performs the stereoscopic image processing. The 
aforementioned sub-camera 5 is attached to a left end of the 
20 camera stay 3 and captures a comparative image (left image) 
for the aforementioned stereoscopic image processing. 

The aforementioned image processing unit 6 calculates the 
three-dimensional distance distribution of objects outside the 
vehicle by image processing the reference image and the 
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comparative image photographed by the aforementioned main 
camera 4 and sub-camera 5, and calculates a relative distance 
and relative speed between own vehicle and a vehicle running 
ahead by detecting road shapes and three-dimensional positions 
of a plurality of three-dimensional objects at a high speed 
based on the three-dimensional distance distribution 
information . 

Calculation of the three-dimensional distance 
distribution by the aforementioned image processing unit 6 is 
now described more specifically. First/ this image processing 
unit 6 sets a search area (e.g., 4xl28pixels) in the comparative 
image for a small region (e.g., 4x4 pixels) in the reference 
image as shown in Figs. 2A and 2B. Then, the image processing 
unit 6 superimposes the small region on an area within the search 
area whi le successively shifting the small region pixel by pixel , 
and determines a position of an area within the search area 
corresponding to the small region, the corresponding area having 
image signal coincident with image signal of the small region. 
Thus, the image processing unit 6 obtains information on the 
distance to an object from a positional difference (parallax) 
of the same object on the two images. 

Here, it is impossible to obtain a corresponding search 
area in the comparative image for small regions located in a 
specific zone at the right side (toward the main camera 4 side) 
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of the reference image as shown in Fig. 2C . Therefore, an area 
in which a three-dimensional distance distribution is generated 
by the image processing unit 6 is inclined toward the left side 
(toward the sub-camera 5 side) of the reference image as shown 
in Fig, 2D. 

Taking into- account the above problem, special 
consideration is given to a structure for mounting the main 
camera 4 and the sub-camera 5 on the camera stay 3 in the stereo 
camera unit 2 of the present embodiment. Specifically, the 
aforementioned main camera 4 and sub-camera 5 are assembled 
to the camera stay 3 in such a way that their optical axes 01, 
02 are inclined by angles 91, 02 toward the main camera 4 side 
(rightward) , respectively, as shown in Fig . 3. In other words , 
the camera stay 3 is installed in vehicle interior such that 
its longitudinal direction would become perpendicular to the 
central axis of the vehicle (shooting direction) as shown in 
Fig. 1 and, therefore, the optical axes 01, 02 of the 
aforementioned main camera 4 and sub-camera 5 are inclined 
rightward by 91, 92 with respect to their shooting direction, 
respectively . 

This is for setting an area of a three-dimensional distance 
distribution, which is offset toward the sub-camera 5 side 
(leftward) within the horizontal view angle of the main camera 
4, substantially symmetrically on left and right sides of the 



central axis of the vehicle as shown in Fig. 1. As a result, 
although the area of the three-dimensional distance 
distribution generating area is still offset toward the 
sub-camera 5 side (leftward) on the reference image as shown 
in Fig. 2D, the area of the three-dimensional distance 
distribution produced by the image processing unit 6 is well 
balanced showing left-right symmetry with respect ' to own 
vehicle . 

On the other hand, the angle of inclination Gl of the main 
camera 4 and the angle of inclination 02 of the sub-camera 5 
are determined to satisfy the relationship 01>92 . In other words , 
the optical axis 02 of the sub-camera 5 is set such that it 
is inclined toward the sub-camera 5 side (leftward) with respect 
to the optical axis 01 of main camera 4. This arrangement is 
made to provide a search margin in the comparative image to 
enable detection of an infinite distance corresponding point 
in stereo matching executed by the image processing unit 6 by 
setting a left end of the comparative image to the outside 
(leftward) of a left end of the reference image. It is to be 
noted, however, that such a setting exerts its effects when 
the reference image is produced using up to extreme ends of 
camera frame. 

The angles of inclination 91, 02 of the aforementioned 
main camera 4 and sub-camera 5 are optimally set depending on 
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their mounting interval;, focal length and the number of pixels 
of each camera, small regions and search area, etc. in 
stereoscopic image processing. 

As thus far described, an area of a three-dimensional 
distance distribution is set with left-right symmetry with 
respect to the central axis of a vehicle and a three-dimensional 
distance distribution having a necessary and sufficient area 
is obtained according to the present invention. 

Also, it becomes possible to search for an infinite distance 
corresponding point by stereo matching by setting a search margin 
in a comparative image even when a reference image is produced 
using up to extreme ends of camera frame. 

While the presently preferred embodiment of the present 
invention has been shown and described, it is to be understood 
that this disclosure is for the purpose of illustration and 
that various changes and modifications may be made without 
departing from the scope of the invention as set forth in the 
appended claims. 



